Newest journal articles by subject

Subjects > Computer Science

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
Michael Tschannen;Alexey GritsenkoXiao WangM. NaeemIbrahim M. AlabdulmohsinNikhil ParthasarathyTalfan EvansLucas BeyerYe XiaBasil MustafaOlivier H'enaffJeremiah HarmsenA. SteinerXiao-Qi Zhai
ArXiv Published 2025/02/20

Summary:

This second iteration of SigLIP 2 introduces SigLIP 2, a family of new multilingual vision-language encoders that build on the success of the original SigLIP, and extends the original image-text training objective with several prior, independently developed techniques into a unified recipe.

DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
DeepSeek-AI;Daya GuoDe-Jian YangHao-Wei ZhangJun-Mei SongRuoyu ZhangRunxin XuQi-Hao ZhuShi-Rong MaPeiyi WangXiaoling BiXiaokang ZhangXing-Kai YuYu WuZ. WuZhibin GouZhihong ShaoZhuo-Shu LiZi-Yi GaoA. LiuBing XueBing-Li WangBochao WuB. FengCheng-Da LuCheng-Gang ZhaoC. DengChen-Yu ZhangC. RuanDa-Mai DaiDe-Li ChenDong-Li JiErhang LiFangyun LinFucong DaiFuli LuoGuangbo HaoGuan-Ting ChenGuowei LiH. ZhangHan BaoHan-Wei XuHao-Cheng WangHonghui DingHuajian XinHua-Zuo GaoHui QuHui LiJianzhong GuoJia-Shi LiJia-Wei WangJing-Chang ChenJing-Yang YuanJun-Jie QiuJun-Long LiJ. CaiJ. NiJian LiangJin ChenKai DongKai HuKaige GaoKang GuanKexin HuangKuai YuLe-An WangLecong ZhangLiang ZhaoLi-Tong WangLi-Yue ZhangLei XuLeyi XiaMing-Chuan ZhangMing-Hua ZhangM. TangMeng LiMiaojun WangMing-Ming LiNing TianPan-Pan HuangPeng ZhangQiancheng WangQinyu ChenQiushi DuRuiqi GeRui-Song ZhangRuizhe PanRunji WangR. J. ChenR. JinRu-Yi ChenShanghao LuShang-Yan ZhouShanhuang ChenShengfeng YeShiyu WangShuiping YuShun-Feng ZhouShuting PanS. LiShuang ZhouShao-Kang WuTao YunTian PeiT. SunT. WangWang-Ding ZengWanjia ZhaoWen LiuW. LiangWen-Jun GaoWen-Xia YuWentao ZhangW. XiaoWei AnXiaodong LiuXiao-Han WangXiao-Kang ChenX. NieXin ChengXin LiuXin XieXing-Chao LiuXin-Yu YangXin-Yuan LiXuecheng SuXuheng LinX. Q. LiXiang-Yu JinXiaojin ShenXiaosha ChenXiaowen SunXiaoxiang WangXinnan SongXinyi ZhouXianzu WangXinxia ShanY. K. LiY. Q. WangY. WeiYang ZhangYan-Hong XuYao LiYao ZhaoYao-Feng SunYao-Hui WangYi YuYichao ZhangYifan ShiYi XiongYing HeY. PiaoYi-Song WangYi-Xuan TanYi-Yang MaYiyuan LiuYong-Qiang GuoY. OuYuduan WangYue GongYu-Jing ZouYujia HeYun-Fan XiongYu-Wei LuoYu-Mei YouYuxuan LiuYuyang ZhouY. X. ZhuYan-Ping HuangYao LiYi ZhengYu-Chen ZhuYun-Xiang MaYing TangYukun ZhaYuting YanZ. RenZehui RenZhangli ShaZhe FuZhe-An XuZhen-Da XieZhengyan ZhangZhewen HaoZhicheng MaZhi-Gang YanZhi-Yu WuZihui GuZi-jia ZhuZijun LiuZi-Long LiZi-Wei XieZiyang SongZi-Zheng PanZhen HuangZhi-Peng XuZhongyu ZhangZhen Zhang
Nature Published 2025/01/22

Summary:

A new artificial intelligence model, DeepSeek-R1, is introduced, demonstrating that the reasoning abilities of large language models can be incentivized through pure reinforcement learning, removing the need for human-annotated demonstrations.

π0.5: a Vision-Language-Action Model with Open-World Generalization
Physical Intelligence;Kevin BlackNoah BrownJames DarpinianKaran DhabaliaDanny DriessA. EsmailM. EquiChelsea FinnNiccolo FusaiManuel Y. GallikerDibya GhoshLachy GroomKarol HausmanBrian IchterS. JakubczakTim JonesLiyiming KeDevin LeBlancSergey LevineAdrian Li-BellMohith MothukuriSuraj NairKarl PertschAllen Z. RenL. ShiLaura SmithJ. SpringenbergKyle StachowiczJames TannerQuan VuongH. WalkeAnna WallingHao-Huan WangLi-Li YuUry Zhilinsky
ArXiv Published 2025/04/22

Summary:

A new model based onpi 0.5 is described that uses co-training on heterogeneous tasks to enable broad generalization and is demonstrated for the first time that an end-to-end learning-enabled robotic system can perform long-horizon and dexterous manipulation skills, such as cleaning a kitchen or bedroom, in entirely new homes.

Gemma 3 Technical Report
Gemma Team Aishwarya Kamath;Johan FerretShreya PathakNino VieillardRamona MerhejSarah PerrinTatiana MatejovicovaAlexandre Ram'eMorgane RivièreLouis RouillardThomas MesnardGeoffrey CideronJean-Bastien GrillSabela RamosEdouard YvinecM. CasbonEtienne PotIvo PenchevGael LiuFrancesco VisinKathleen KenealyLucas BeyerXiaohai ZhaiAnton TsitsulinR. Busa-FeketeAlex FengNoveen SachdevaBenjamin ColemanYi GaoBasil MustafaIain BarrEmilio ParisottoDavid TianMatan EyalColin CherryJan-Thorsten PeterDanila SinopalnikovSurya BhupatirajuRishabh AgarwalMehran KazemiDan MalkinRavin KumarDavid VilarI. BrusilovskyJiaming LuoA. SteinerAbe FriesenAbhanshu SharmaAbheesht SharmaAdi Mayrav GiladyAdrian GoedeckemeyerAlaa SaadeAlexander KolesnikovAlexei BendeburyAlvin AbdagicAmit VadiAndr'as GyorgyAndré Susano PintoAnil DasAnkur BapnaAntoine MiechAntoine YangAntonia PatersonAshish ShenoyAyan ChakrabartiBilal PiotBoxi WuBobak ShahriariBryce PetriniCharlie ChenCharline Le LanChristopher A. Choquette-ChooCj CareyC. BrickDaniel DeutschDanielle EisenbudDee CattleD. ChengDimitris PaparasDivyashree Shivakumar SreepathihalliDoug ReidDustin TranDustin ZelleEric NolandErwin HuizengaE. KharitonovFrederick LiuG. AmirkhanyanGlenn CameronHadi HashemiHanna Klimczak-Pluci'nskaHarman SinghHarsh MehtaHarshal Tushar LehriHussein HazimehIan BallantyneIdan SzpektorIvan NardiniJean Pouget-AbadieJetha ChanJoe StantonJ. Michael WietingJ. LaiJordi OrbayJoe FernandezJoshua NewlanJunsong JiJyotinder SinghKat BlackKathy YuKevin HuiKiran VodrahalliKlaus GreffLinhai QiuMarcella ValentineMarina CoelhoMarvin RitterMatt HoffmanMatthew WatsonMayank ChaturvediMichael MoynihanMin MaNabila BabarNatasha NoyNathan ByrdNick RoyNikola MomchevNilay ChauhanOskar BunyanPankil BotardaPaul CaronP. RubensteinPhil CullitonP. SchmidPier Giuseppe SessaPing-mei XuP. StańczykP. TaftiRakesh ShivannaRenjie WuRenke PanR. RokniRob WilloughbyRohith ValluRyan MullinsSammy JeromeSara SmootSertan GirginShariq IqbalShashir ReddyShruti ShethSiim PõderSijal BhatnagarSindhu Raghuram PanyamSivan EigerSusan ZhangTianqi LiuTrevor YacovoneT. LiechtyUday KalraUtku EvciVedant MisraVincent RoseberryVladimir FeinbergV. KolesnikovWoohyun HanWoosuk KwonXi ChenYinlam ChowYuvein ZhuZichuan WeiZ. EgyedVictor CotrutaMinh GiangPhoebe KirkAnand RaoJessica LoErica MoreiraLuiz Gustavo MartinsOmar SansevieroLucas GonzalezZach GleicherT. WarkentinV. MirrokniEvan SenterEli CollinsJoelle BarralZ. GhahramaniR. HadsellY. MatiasD. SculleySlav PetrovNoah FiedelNoam ShazeerO. VinyalsJeffrey DeanD. HassabisK. KavukcuogluC. FarabetElena BuchatskayaJean-Baptiste AlayracRohan AnilDmitry LepikhinSebastian BorgeaudOlivier BachemArmand JoulinAlek AndreevCassidy HardinRobert DadashiL'eonard Hussenot
ArXiv Published 2025/03/25

Summary:

A novel post-training recipe significantly improves the math, chat, instruction-following and multilingual abilities, making Gemma3-4B-IT competitive with Gemma2-27B-IT and Gemma3-27B-IT comparable to Gemini-1.5-Pro across benchmarks.

GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
Johan Bjorck;Fernando CastañedaNikita CherniadevXingye DaRunyu DingL. FanYu FangDieter FoxFengyuan HuSpencer HuangJoel JangZhenyuan JiangJan KautzKaushil KundaliaLawrence LaoZhi-Qi LiZongyu LinKevin LinGuilin LiuEdith LlontopLoic MagneA. MandlekarAvnish NarayanSoroush NasirianyScott ReedYou TanGuanzhi WangZu WangJing WangQi WangJiannan XiangYuqi XieYinzhen XuZhen-Teng XuSeonghyeon YeZhi-Ding YuAo ZhangHao ZhangYizhou ZhaoRuijie ZhengYu-Ke Zhu
ArXiv Published 2025/03/18

Summary:

This work introduces GR00T N1, an open foundation model for humanoid robots that outperforms the state-of-the-art imitation learning baselines on standard simulation benchmarks across multiple robot embodiments and deploys the model on the Fourier GR-1 humanoid robot for language-conditioned bimanual manipulation tasks.

FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space
Black Forest Labs;Stephen BatifolA. BlattmannFrederic BoeselSaksham ConsulCyril DiagneTim DockhornJack EnglishZion EnglishPatrick EsserSumith KulalKyle LaceyYam LeviCheng LiDominik LorenzJonas MullerDustin PodellRobin RombachHarry SainiAxel SauerLuke Smith
ArXiv Published 2025/06/17

Summary:

Compared to current editing models that exhibit degradation in character consistency and stability across multiple turns, it is observed that FLUX.1 Kontext improved preservation of objects and characters, leading to greater robustness in iterative workflows.

AlphaEvolve: A coding agent for scientific and algorithmic discovery
Alexander Novikov;Ngân VuMarvin EisenbergerEmilien DupontPo-Sen HuangAdam Zsolt WagnerS. ShirobokovB. KozlovskiiFrancisco J. R. RuizAbbas MehrabianM. P. KumarAbigail SeeSwarat ChaudhuriGeorge HollandA. DaviesSebastian NowozinPushmeet KohliMatej Balog
ArXiv Published 2025/06/16

Summary:

AlphaEvolve is an evolutionary coding agent that substantially enhances capabilities of state-of-the-art LLMs on highly challenging tasks such as tackling open scientific problems or optimizing critical pieces of computational infrastructure.

Cosmos World Foundation Model Platform for Physical AI
Niket Agarwal;Arslan AliM. BalaYogesh BalajiErik BarkerTiffany CaiPrithvijit ChattopadhyayYongxin ChenYin CuiYi-Fan DingDaniel DworakowskiJiao-Jiao FanMichele FenziFrancesco FerroniSanja FidlerDieter FoxSongwei GeYunhao GeJinwei GuSiddharth GururaniEthan HeJia-Hui HuangJ. HuffmanPooya JannatyJingyi JinS. KimG. KlárG. LamShiyi LanL. Leal-TaixéAn-Qi LiZhao-Shuo LiChen-Hsuan LinTsung-Yi LinHuan LingMing-Yu LiuXian LiuAlice LuoQian-Li MaHanzi MaoKaichun MoA. MousavianSeungjun NahSriharsha NivertyDavid PageDespoina PaschalidouZeeshan PatelLindsey PavaoMorteza RamezanaliF. RedaXiao-Shuai RenVasanth Rao Naik SabavatE. SchmerlingStella ShiBartosz StefaniakShitao TangLyne P. TchapmiPrzemek TredakWei-Cheng TsengJ. VargheseHao WangHao-Xiang WangHeng WangTingwei WangFangyin WeiXinyue WeiJay Zhangjie WuJiashu XuWei YangYen-Chen LinXiaohui ZengYuan ZengJing ZhangQinsheng ZhangYuxuan ZhangQingqing ZhaoArtur Zolkowski
ArXiv Published 2025/01/06

Summary:

The Cosmos World Foundation Model Platform is presented to help developers build customized world models for their Physical AI setups and position a world foundation model as a general-purpose world model that can be fine-tuned into customized world models for downstream applications.

Toward expert-level medical question answering with large language models
Karan Singhal;Tao TuJuraj GottweisR. SayresEllery WulczynMohamed AminLe HouKevin ClarkStephen R. PfohlHeather Cole-LewisDarlene NealQ. RashidMike SchaekermannAmy WangD. DashJonathan H. ChenNigam H. ShahSami LachgarP. MansfieldSushant PrakashBradley GreenEwa DominowskaBlaise Agüera Y. ArcasNenad TomaševYun LiuRenee WongChristopher SemtursS. MahdaviJoelle K. BarralDale R. WebsterG. CorradoY. MatiasShekoofeh AziziA. KarthikesalingamVivek Natarajan
Nature Medicine Published 2025/01/08

Summary:

With an improved framework for model development and evaluation, a large language model is shown to provide answers to medical questions that are comparable or preferred with respect to those provided by human physicians.

V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
Mido Assran;Adrien BardesDavid FanQ. GarridoRussell HowesMojtaba KomeiliMatthew MuckleyAmmar RizviClaire RobertsKoustuv SinhaArtem ZholusSergio ArnaudAbha GejjiAda MartinFrancois HoganDaniel DugasPiotr BojanowskiVasil KhalidovPatrick LabatutFrancisco MassaMarc SzafraniecK. KrishnakumarYong LiXiaodong MaA. P. Sarath ChandarFranziska MeierYann LeCunMichael RabbatNicolas Ballas
ArXiv Published 2025/06/11

Summary:

This work demonstrates how self-supervised learning from web-scale data and a small amount of robot interaction data can yield a world model capable of planning in the physical world.

Revised Surgical CAse REport (SCARE) guideline: An update for the age of Artificial Intelligence
Ahmed Kerwan;A. Al-JabirGinimol MathewC. SohrabiRasha RashidT. FranchiMaria NicolaM. AghaR. Agha
Premier Journal of Science

Summary:

The SCARE 2025 guideline provides an up-to-date framework for surgical case reports in the era of AI and adds specific reporting criteria for AI to ensure that any use of artificial intelligence in a case report is clearly documented, explained and discussed including with respect to bias and ethics.

Continuous 3D Perception Model with Persistent State
Qian-Qian Wang;Yifei ZhangAleksander HolynskiAlexei A. EfrosAngjoo Kanazawa
2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Published 2025/01/21

Summary:

The model, called CUT3R (Continuous Updating Transformer for 3D Reconstruction), captures rich priors of real-world scenes: not only can it predict accurate pointmaps from image observations, but it can also infer unseen regions of the scene by probing at virtual, unobserved views.

Why Do Multi-Agent LLM Systems Fail?
M. Cemri;Melissa Z. PanShuyi YangLakshya A. AgrawalBhavya ChopraRishabh TiwariKurt KeutzerAditya G. ParameswaranDan KleinK. RamchandranMatei A. ZahariaJoseph GonzalezIon Stoica
ArXiv Published 2025/03/17

Summary:

This work builds the first Multi-Agent System Failure Taxonomy (MAST), a comprehensive dataset of 1600+ annotated traces collected across 7 popular MAS frameworks, and develops an LLM-as-a-Judge pipeline with high agreement with human annotations to enable scalable annotation.

Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
Mike A. Merrill;Alexander G ShawNicholas CarliniBoxuan LiH. RajI. BercovichLin ShiJ. ShinThomas WalsheE. K. BuchananJunhong ShenGuanghao YeHao LinJason PoulosMao-Yu WangMarianna NezhurinaJ. JitsevDi LuOrfeas Menis-MastromichalakisZhiwei XuZizhao ChenYue LiuRobert ZhangL. ChenAnurag KashyapJan-Lucas UsluJeffrey LiJianbo WuMinghao YanSong BianVedang SharmaKe SunS. DillmannAkshay AnandAndrew LanpouthakounBardia KoopahChangran HuE. GuhaGabriel H. S. DreimanJia-Cheng ZhuKarl KrauthLi ZhongNiklas MuennighoffRobert K. AmanfuShangyin TanShreyas PimpalgaonkarTushar AggarwalXiang-Ning LinXin LanXuandong ZhaoYi-Qing LiangYuan-Li WangZi-Long WangChangzhi ZhouDavid HeinemanHange LiuH. TrivediJohn YangJun-Hong LinManish ShettyMichael YangNabil OmiNegin RaoofShanda LiTerry Yue ZhuoWu LinYi-Wei DaiYu-Xin WangWen-Hao ChaiShang ZhouDariush WahdanyZi-Yu SheJia-Ming HuZhikang DongYuxuan ZhuSasha CuiAhson SaiyedArinbjörn KolbeinssonJesse HuChristopher RyttingRyan MartenYi-Xin WangA. DimakisA. KonwinskiLudwig Schmidt
ArXiv Published 2026/01/17

Summary:

Terminal-Bench 2.0 is presented: a carefully curated hard benchmark composed of 89 tasks in computer terminal environments inspired by problems from real workflows and shows that frontier models and agents score less than 65\% on the benchmark and conducts an error analysis to identify areas for model and agent improvement.

Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet
Adly Templeton;Tom ConerlyJonathan MarcusJack LindseyTrenton BrickenBrian K. ChenAdam PearceCraig CitroE. AmeisenAndy JonesHoagy CunninghamN. TurnerCallum McDougallM. MacDiarmidA. TamkinEsin DurmusTristan HumeFrancesco MosconiC. D. FreemanT. SumersE. ReesJoshua BatsonAdam S. JermynShan CarterChris OlahT. Henighan
ArXiv Published 2026/05/28
Transparency In The reporting of Artificial INtelligence – the TITAN guideline
R. Agha;Ginimol MathewRasha RashidAhmed KerwanA. Al-JabirC. SohrabiT. FranchiMaria NicolaM. Agha
Premier Journal of Science

Summary:

A guideline to transparently reporting the use of AI in any manuscript in general is presented and will evolve over time as technology, systems and behaviour evolve.

PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods
K. Moons;J. DamenT. KaulL. HooftC. Andaur NavarroP. DhimanA. BeamB. van CalsterL. CeliS. DenaxasA. DennistonMarzyeh GhassemiG. HeinzeA. KengneLena Maier-HeinXiaoxuan LiuPatricia LogulloMelissa D. McCraddenNan LiuLauren Oakden-RaynerKarandeep SinghD. TingL. WynantsBada YangJ. ReitsmaR. RileyGary S. CollinsM. van Smeden
The BMJ Published 2025/03/24

Summary:

The development of PROBAST+AI is described, which may replace the original PROBAST tool and allows all key stakeholders to examine the quality, risk of bias, and applicability of any type of prediction model in the healthcare sector, irrespective of whether regression modelling or AI techniques are used.

ARTIFICIAL INTELLIGENCE IN EDUCATION: CHALLENGES AND OPPORTUNITIES FOR SUSTAINABLE DEVELOPMENT
S. A. Vakhabova;V. KosulinAna Zizaeva
EKONOMIKA I UPRAVLENIE: PROBLEMY, RESHENIYA

Summary:

The results show the significant potential of AI in personalizing learning, automating routine tasks, and providing access to knowledge, but also reveal serious risks of exacerbating social inequality and ethical dilemmas.

Revised Strengthening the reporting of cohort, cross-sectional and case-control studies in surgery (STROCSS) Guideline: An update for the age of Artificial Intelligence
R. Agha;Ginimol MathewRasha RashidAhmed KerwanA. Al-JabirC. SohrabiT. FranchiMaria NicolaM. Agha
Premier Journal of Science

Summary:

The STROCSS 2025 guideline provides an up-to-date framework for surgical observational studies in the era of AI and adds specific reporting criteria for AI to ensure that any use of artificial intelligence in a surgical observational study is clearly documented, explained and discussed including with respect to bias and ethics.

π0: A Vision-Language-Action Flow Model for General Robot Control
Kevin Black;Noah BrownDanny DriessA. EsmailM. EquiChelsea FinnNiccolo FusaiLachy GroomKarol HausmanBrian IchterS. JakubczakTim JonesLiyiming KeSergey LevineAdrian Li-BellMohith MothukuriSuraj NairKarl PertschL. ShiJames TannerQuan VuongAnna WallingHao-Huan WangUry Zhilinsky
ArXiv Published 2024/10/31

Summary:

A novel flow matching architecture built on top of a pre-trained vision-language model (VLM) to inherit Internet-scale semantic knowledge is proposed and evaluated in terms of its ability to perform tasks in zero shot after pre-training, follow language instructions from people and from a high-level VLM policy, and its ability to acquire new skills via fine-tuning.

OpenVLA: An Open-Source Vision-Language-Action Model
Moo Jin Kim;Karl PertschSiddharth KaramchetiTed XiaoA. BalakrishnaSuraj NairRafael RafailovE. FosterG. LamPannag R. SanketiQuan VuongThomas KollarBenjamin BurchfielRuss TedrakeDorsa SadighSergey LevinePercy LiangChelsea Finn
ArXiv Published 2024/06/13

Summary:

OpenVLA, a 7B-parameter open-source VLA trained on a diverse collection of 970k real-world robot demonstrations, is introduced and it is shown that it can effectively fine-tune OpenVLA for new settings, with especially strong generalization results in multi-task environments involving multiple objects and strong language grounding abilities.

Scaling Rectified Flow Transformers for High-Resolution Image Synthesis
Patrick Esser;Sumith KulalA. BlattmannRahim EntezariJonas MullerHarry SainiYam LeviDominik LorenzAxel SauerFrederic BoeselDustin PodellTim DockhornZion EnglishKyle LaceyAlex GoodwinYannik MarekRobin Rombach
Published 2024/03/05

Summary:

This work improves existing noise sampling techniques for training rectified flow models by biasing them towards perceptually relevant scales and presents a novel transformer-based architecture for text-to-image generation that uses separate weights for the two modalities and enables a bidirectional flow of information between image and text tokens.

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Marah Abdin;Sam Adé JacobsA. AwanJ. AnejaA. AwadallahH. AwadallaNguyen BachAmit BahreeArash BakhtiariHarkirat Singh BehlAlon BenhaimMisha BilenkoJohan BjorckSébastien BubeckMartin CaiC. C. T. MendesWei-Zhu ChenVishrav ChaudharyParul ChopraA. GiornoGustavo de RosaMatthew DixonRonen EldanVictor FragosoDan IterAbhishek GoswamiSuriya GunasekarEmman HaiderJunheng HaoRussell J. HewettJamie HuynhMojan JavaheripiXin JinPiero KauffmannNikos KarampatziakisDongwoo KimYoung Jin KimMahoud KhademiLev KurilenkoJames R. LeeY. LeeYuanzhi LiChen LiangWeishung LiuEric LinZeqi LinPiyush MadanArindam MitraHardik ModiAnh NguyenBrandon NorickBarun PatraD. Perez-BeckerThomas PortetReid PryzantHeyang QinMarko RadmilacLiliang RenCorby RossetSambudha RoyOlli SaarikiviA. SaiedAdil SalimMichael SantacroceShital ShahNing ShangHiteshi SharmaXia SongOlatunji RuwasePraneetha VaddamanuXin WangRachel WardGuan-Hua WangP. WitteMichael WyattCan XuJiahang XuSonal YadavFan YangZiyi YangDonghan YuChengruidong ZhangCyril ZhangJianwen ZhangL. ZhangYi ZhangYunan ZhangXi-Rui ZhouYifan Yang
ArXiv Published 2024/04/22
Accurate structure prediction of biomolecular interactions with AlphaFold 3
Josh Abramson;Jonas AdlerJack DungerRichard EvansT. GreenA. PritzelOlaf RonnebergerLindsay WillmoreAndrew J BallardJoshua BambrickSebastian BodensteinDavid A EvansChia-Chun HungMichael O’NeillD. ReimanKathryn TunyasuvunakoolZachary WuAkvile ZemgulyteEirini ArvanitiCharles BeattieOttavia BertolliAlex BridglandAlexey CherepanovMiles CongreveA. I. Cowen-RiversAndrew CowieMichael FigurnovFabian B FuchsHannah GladmanRishub JainYousuf A. KhanCaroline M R LowKuba PerlinAnna PotapenkoPascal SavySukhdeep SinghA. SteculaAshok ThillaisundaramCatherine TongSergei YakneenEllen D. ZhongMichal ZielinskiAugustin ŽídekV. BapstPushmeet KohliMax JaderbergD. HassabisJ. Jumper
Nature Published 2024/05/08

Summary:

The new AlphaFold model demonstrates substantially improved accuracy over many previous specialized tools: far greater accuracy for protein–ligand interactions compared with state-of-the-art docking tools, much higher accuracy for protein–nucleic acid interactions compared with nucleic-acid-specific predictors and substantially higher antibody–antigen prediction accuracy.

Gemma 2: Improving Open Language Models at a Practical Size
Gemma Team Morgane Riviere;Shreya PathakPier Giuseppe SessaCassidy HardinSurya BhupatirajuL'eonard HussenotThomas MesnardBobak ShahriariAlexandre Ram'eJohan FerretPeter LiuP. TaftiAbe FriesenM. CasbonSabela RamosRavin KumarCharline Le LanSammy JeromeAnton TsitsulinNino VieillardP. StańczykSertan GirginNikola MomchevMatt HoffmanS. ThakoorJean-Bastien GrillBehnam NeyshaburAlanna WaltonA. SeverynAlicia ParrishAliya AhmadAllen HutchisonAlvin AbdagicAmanda CarlAmy ShenAndy BrockAndy CoenenAnthony LaforgeAntonia PatersonBen BastianBilal PiotBoxi WuBrandon RoyalCharlie ChenChintu KumarChris PerryChristoper A. WeltyChristopher A. Choquette-ChooDanila SinopalnikovDavid Wein-bergerD. VijaykumarDominika Rogozi'nskaD. HerbisonElisa BandyEmma WangEric NolandErica MoreiraEvan SenterEvgenii EltyshevFrancesco VisinGabriel RasskinGary WeiGlenn CameronGus MartinsHadi HashemiHanna Klimczak-Pluci'nskaHarleen BatraH. DhandIvan NardiniJacinda MeinJack ZhouJames SvenssonJ. StanwayJetha ChanJin ZhouJoana CarrasqueiraJoana IljaziJocelyn BeckerJoe FernandezJoost R. van AmersfoortJ. GordonJosh LipschultzJoshua NewlanJunsong JiKareem MohamedKartikeya BadolaKat BlackKatie Milli-canK. McDonellK. NguyenKiranbir SodhiaKish GreeneLars Lowe SjoesundLauren UsuiL. SifreL. HeuermannLeti-cia LagoLilly McNealusLivio Baldini SoaresLogan KilpatrickLucas DixonLuciano MartinsMachel ReidManvinder SinghMark IversonM. GornerM. VellosoMateo WirthMatt DavidowMatt MillerMatthew RahtzMatthew WatsonMeg RisdalMehran KazemiMichael MoynihanMing ZhangMinsuk KahngMinwoo ParkMofi RahmanM. KhatwaniN. DaoNen-shad BardoliwallaN. DevanathanNeta DumaiNilay ChauhanOscar WahltinezPankil BotardaParker BarnesP. BarhamPaul MichelPeng-chong JinPetko GeorgievPhil CullitonPradeep KuppalaR. ComanescuRamona MerhejReena JanaR. RokniRishabh AgarwalRyan MullinsSamaneh SaadatS. M. CarthySarah PerrinSébastien M. R. ArnoldSe-bastian KrauseShengyang DaiS. GargShruti ShethS. RonstromSusan ChanTimothy JordanTing YuTom EcclesT. HenniganTomás KociskýTulsee DoshiVihan JainVikas YadavVilobh MeshramVishal DharmadhikariWarren BarkleyWei WeiWenming YeWoohyun HanWoosuk KwonXiang XuZhe ShenZhitao GongZichuan WeiVictor CotrutaPhoebe KirkAnand RaoMinh GiangLudovic PeranT. WarkentinEli CollinsJoelle BarralZ. GhahramaniR. HadsellD. SculleyJeanine BanksAnca D. DraganSlav PetrovO. VinyalsJeffrey DeanD. HassabisK. KavukcuogluC. FarabetElena BuchatskayaSebastian BorgeaudNoah FiedelArmand JoulinKathleen KenealyRobert DadashiAlek Andreev
ArXiv Published 2024/07/31

Summary:

Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters, delivers the best performance for their size, and even offers competitive alternatives to models that are 2-3 times bigger.

PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph Compilation
Jason Ansel;Edward Z. YangHorace HeN. GimelsheinAnimesh JainMichael VoznesenskyBin BaoPeter BellD. BerardEvgeni BurovskiGeeta ChauhanAnjali ChourdiaW. ConstableAlban DesmaisonZachary DeVitoElias EllisonW. FengJiong GongMichael GschwindB. HirshSherlock HuangKshiteej KalambarkarLaurent KirschMichael LazosM. LezcanoYanbo LiangJ. LiangYinghai LuC. LukBertrand A. MaherYunjie PanChristian PuhrschMatthias ResoMark-Albert SaroufimMarcos Yukio SiraichiHelen SukShunting ZhangMichael SuoP. TilletXu ZhaoEikan WangKeren ZhouRichard ZouXiao-Dong WangAjit MathewsW. WenGregory ChananPeng WuSoumith Chintala
Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 Published 2024/04/27

Summary:

Results show that TorchDynamo is able to capture graphs more robustly than prior approaches while adding minimal overhead, and TorchInductor is able to provide a 2.41× training geometric mean speedup on an NVIDIA A100 GPU across 180+ real-world models, which outperforms six other compilers.

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
Guilherme Penedo;Hynek KydlícekLoubna Ben AllalAnton LozhkovMargaret MitchellColin A. RaffelLeandro von WerraThomas Wolf
ArXiv Published 2024/06/25

Summary:

FineWeb is introduced, a 15-trillion token dataset derived from 96 Common Crawl snapshots that produces better-performing LLMs than other open pretraining datasets and FineWeb-Edu, a 1.3-trillion token collection of educational text filtered from FineWeb.

Gemma: Open Models Based on Gemini Research and Technology
Gemma Team Thomas Mesnard;Cassidy HardinRobert DadashiSurya BhupatirajuShreya PathakL. SifreMorgane RivièreMihir KaleJuliette LoveP. TaftiL'eonard HussenotPier Giuseppe SessaA. ChowdheryAdam RobertsAditya BaruaAlex BotevAlex Castro-RosAmbrose SloneA. HéliouAndrea TacchettiAnna BulanovaAntonia PatersonBeth TsaiBobak ShahriariCharline Le LanChristopher A. Choquette-ChooClé-ment CrepyDaniel CerDaphne IppolitoDavid ReidElena BuchatskayaEric NiEric NolandGeng YanGeorge TuckerGeorge-Christian MuraruGrigory RozhdestvenskiyH. MichalewskiIan TenneyIvan GrishchenkoJacob AustinJames KeelingJane LabanowskiJean-Baptiste LespiauJ. StanwayJenny BrennanJeremy ChenJohan FerretJustin ChiuJ. Mao-JonesKather-ine LeeKathy YuKatie Milli-canLars Lowe SjoesundLisa LeeLucas DixonMachel ReidMaciej MikułaMateo WirthMichael SharmanNikolai ChinaevNithum ThainOlivier BachemOs-car ChangOscar WahltinezPaige BaileyPaul MichelPetko YotovR. ChaabouniR. ComanescuReena JanaRohan AnilRoss McilroyRuibo LiuRyan MullinsSamuel L. SmithSebastian BorgeaudSertan GirginSholto DouglasShree PandyaSiamak ShakeriSoham DeTed KlimenkoT. HenniganVladimir FeinbergWojciech StokowiecYu-Hui ChenZafarali AhmedZhitao GongT. WarkentinLudovic PeranMinh GiangC. FarabetO. VinyalsJeffrey DeanK. KavukcuogluD. HassabisZ. GhahramaniDouglas EckJoelle BarralFernando PereiraEli CollinsArmand JoulinNoah FiedelEvan SenterAlek AndreevKathleen Kenealy
ArXiv Published 2024/03/13

Summary:

This work introduces Gemma, a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models, and presents comprehensive evaluations of safety and responsibility aspects of the models, alongside a detailed description of model development.

The EMBL-EBI Job Dispatcher sequence analysis tools framework in 2024
F. Madeira;Nandana MadhusoodananJoon LeeAlberto EusebiAnia NiewielskaA. TiveyRodrigo LopezSarah Butcher
Nucleic Acids Research Published 2024/04/10

Summary:

Recent improvements to Job Dispatcher are overviews, including its brand new website and documentation, enhanced visualisations, improved job management, and a rising trend of user reliance on the service from low- and middle-income regions.

A visual-language foundation model for computational pathology
Ming Y. Lu;Bowen ChenDrew F. K. WilliamsonRichard J. ChenIvy LiangTong DingG. JaumeIgor OdintsovL. LeGeorg K. GerberA. ParwaniAndrew ZhangFaisal Mahmood
Nature medicine Published 2024/03/01

Summary:

This work introduces CONtrastive learning from Captions for Histopathology (CONCH), a visual-language foundation model developed using diverse sources of histopathology images, biomedical text and, notably, over 1.17 million image–caption pairs through task-agnostic pretraining, and represents a substantial leap over concurrent visual-language pretrained systems for histopathology.

UniProt: the Universal Protein Knowledgebase in 2025
Alex Bateman;M. MartinSandra OrchardM. MagraneA. AdesinaShadab AhmadE. Bowler-BarnettHema Bye-A-JeeD. CarpentierP. DennyJun FanPenelope GarmiriLeonardo Jose da Costa GonzalesAbdulrahman HusseinA. IgnatchenkoGiuseppe InsanaRizwan IshtiaqVishal JoshiDushyanth JyothiSwaathi KandasaamyA. LockAurélien LucianiJie LuoYvonne LussiJ. MarinPedro RaposoDan RiceRafael SantosE. SperettaJames L. StephensonPrabhat TotooNidhi TyagiNadya UrakovaPreethi VasudevKate WarnerSupun WijerathneC. W. YuR. ZaruAlan J. BridgeL. AimoGhislaine Argoud-PuyA. AuchinclossK. AxelsenParit BansalDelphine BaratinTeresa BatistaMarie-Claude BlatterJerven T. BollemanE. BoutetLionel BreuzaBlanca Cabrera GilCristina Casals-CasasKamal Chikh EchioukhE. CoudertB. CucheE. de CastroA. EstreicherM. FamigliettiM. FeuermannElisabeth GasteigerPascale GaudetS. GehantV. GerritsenA. GosNadine GruazC. HuloNevila Hyka-NouspikelF. JungoArnaud KerhornouP. Le MercierD. LieberherrP. MassonA. MorgatS. PaesanoI. PedruzziS. PilboutL. PourcelS. PouxM. PozzatoManuela PruessNicole RedaschiC. RivoireChristian J A SigristKarin SonessonS. SundaramAnastasia SveshnikovaCathy H. WuC. ArighiChu-Ming ChenYongxing ChenHong-Zhan HuangK. LaihoMinna LehvaslaihoPeter B. McGarveyD. NataleKaren RossC. R. VinayakaYu-Qi WangJian Zhang
Nucleic Acids Research Published 2024/11/18
Chronos: Learning the Language of Time Series
Abdul Fatir Ansari;Lorenzo StellaA. TürkmenXi-Yuan ZhangPedro MercadoHuibin ShenOleksandr ShchurSyama Sundar RangapuramSebastian Pineda-ArangoShubham KapoorJasper ZschiegnerD. MaddixHao WangMichael W. MahoneyKari TorkkolaAndrew Gordon WilsonMichael Bohlke-SchneiderBernie Wang
ArXiv Published 2024/03/12

Summary:

It is shown that Chronos models significantly outperform other methods on datasets that were part of the training corpus; and have comparable and occasionally superior zero-shot performance on new datasets, relative to methods that were trained specifically on them.

Quantum error correction below the surface code threshold
R. Acharya;D. AbaninLaleh Aghababaie-BeniI. AleinerT. AndersenM. AnsmannF. AruteK. AryaA. AsfawN. AstrakhantsevJ. AtalayaR. BabbushDave BaconB. BallardJ. BardinJohannes BauschA. BengtssonA. BilmesS. BlackwellS. BoixoG. BortoliA. BourassaJ. BovairdL. BrillM. BroughtonD. BrowneB. BucheaB. BuckleyD. BuellT. BurgerB. BurkettN. BushnellA. CabreraJ. CamperoHung-Shen ChangYu ChenZi-Jun ChenB. ChiaroDesmond ChikCharina ChouJ. ClaesA. ClelandJ. CoganR. CollinsP. ConnerW. CourtneyA. CrookB. CurtinSayan DasA. DaviesL. de LorenzoD. DebroyS. DemuraM. DevoretA. Di PaoloP. DonohoeI. DrozdovA. DunsworthC. EarleT. EdlichA. EickbuschA. ElbagM. ElzoukaC. EricksonL. FaoroE. FarhiV. FerreiraL. BurgosE. ForatiA. FowlerB. FoxenS. GanjamG. GarcíaR. Gasca'. GenoisW. GiangC. GidneyD. GilboaR. GosulaA. DauD. GraumannA. GreeneJ. GrossS. HabeggerJohn HallMichael C. HamiltonM. HansenM. HarriganS. HarringtonF. HerasS. HeslinP. HeuO. HiggottG. HillJ. HiltonGeorge HollandSabrina HongHsin-Yuan HuangA. HuffW. HugginsL. IoffeS. IsakovJ. IvelandE. JeffreyZhang JiangCody JonesS. JordanC. JoshiP. JuhásD. KafriHui KangA. KaramlouK. KechedzhiJ. KellyT. KhaireT. KhattarM. KhezriSeon KimP. KlimovA. KlotsB. KobrinPushmeet KohliA. KorotkovF. KostritsaRobin KothariB. KozlovskiiJ. KreikebaumV. KurilovichN. LacroixD. LandhuisT. Lange-DeiB. LangleyP. LaptevK. LauL. Le GuevelJ. LedfordJoonho LeeKenny LeeY. LenskyShannon LeonB. LesterWing LiYin LiA. LillWayne LiuW. LivingstonA. LocharlaE. LuceroD. LundahlA. LuntS. MadhukF. D. MaloneA. MaloneyS. MandráJ. ManyikaL. MartinO. MartinSteven MartinC. MaxfieldJ. McCleanM. McEwenS. MeeksA. MegrantX. MiK. MiaoA. MieszalaR. MolaviS. MolinaS. MontazeriA. MorvanR. MovassaghW. MruczkiewiczO. NaamanMatthew NeeleyC. NeillA. NersisyanH. NevenMichael NewmanJ. NgA. NguyenM. NguyenChia-Hung NiM. NiuT. O'BrienW. D. OliverA. OpremcakK. OttossonA. PetukhovA. PizzutoJohn C. PlattR. PotterO. PritchardL. PryadkoC. QuintanaG. RamachandranM. ReagorJohn ReddingD. RhodesG. RobertsE. RosenbergEmma L. RosenfeldP. RoushanN. RubinN. SaeiD. SankK. SankaragomathiK. SatzingerH. SchurkusC. SchusterA. W. SeniorM. ShearnA. ShorterN. ShuttyV. ShvartsShraddha SinghV. SivakJ. SkruznyS. SmallV. SmelyanskiyW. SmithR. SommaS. SpringerG. SterlingD. StrainJ. SuchardA. SzaszA. SzteinD. ThorA. TorresM. TorunbalciA. VaishnavJ. VargasS. VdovichevG. VidalB. VillalongaC. HeidweillerS. WaltmanShannon WangB. WareKate WeberTravis WeidelT. WhiteK. WongBryan W. K. WooC. XingZ. YaoP. YehB. YingJuhwan YooN. YosriG. YoungAdam ZalcmanYa-Xing ZhangN. ZhuN. Zobrist
Nature Published 2024/08/24

Summary:

Two below-threshold surface code memories on Willow, a distance-7 code and a distance-5 code integrated with a real-time decoder, indicate device performance that, if scaled, could realize the operational requirements of large-scale fault-tolerant quantum algorithms.

The Galaxy platform for accessible, reproducible, and collaborative data analyses: 2024 update
Linelle Ann L Enis Olivier Ahmed H Wendi A Dannon Madeline Abueg Afgan Allart Awan Bacon Baker Bassetti Batut;L. AbuegE. AfganOlivier AllartA. H. AwanW. BaconD. BakerMadeline E. BassettiBérénice BatutMatthias BerntDaniel J. BlankenbergA. BombarelyAnthony BretaudeauCatherine J. BromheadMelissa L BurkePatrick K. CaponMartin ČechMaría Chavero-DiezJ. ChiltonTyler CollinsFrederik CoppensNate CoraorG. CuccuruFabio CumboJohn DavisPaul De GeestW. de KoningM. DemkoAssunta D. DesantoJ. D. BeginesMaria A. DoyleBert DroesbekeAnika Erxleben-EggenhoferM. FöllG. FormentiA. FouillouxRendani GangazheTanguy GenthonJeremy GoecksA. N. González BeltránN. GoonasekeraNadia GouéT. GriffinB. GrüningAysam GuerlerSveinung GundersenO. J. R. GustafssonChristina R. HallT. HarropHelge HechtA. HeidariTillman HeisnerFlorian HeylS. HiltemannH. HotzCameron J. HydeP. JagtapJulia JakielaJames E. JohnsonJayadev JoshiMarie JosséKhaled Jum'ahM. KalašKatarzyna KamienieckaTunc KayikciogluM. KonkolLeonid KostrykinNatalie KucherAnup KumarM. KuntzDelphine LarivièreR. LazarusY. Le BrasG. Le CorguilléJustin LeeSimone LeoL. LiborioRomane LiboubanD. TaberneroLucille Lopez-DelisleLaila S. LosAlexandru MahmoudI. MakuninP. MarinSubina P. MehtaWinnie MokPablo MorenoFrançois Morier-GenoudStephen MosherTeresa MüllerEngy NasrAnton NekrutenkoTiffanie M. NelsonAsime ObaAlexander E. OstrovskyPolina V. PoluninaKrzysztof PoterlowiczE. PriceGareth R. PriceH. RascheBryan A. RaubenoltColine RoyauxLuke SargentM. SavageVolodymyr SavchenkoD. SavchenkoMichael C. SchatzPauline SeguineauBeatriz Serrano-SolanoNicola SoranzoSanjay Kumar SrikakulamKeith SudermanAnna SymeM. TangaroJonathan TeddsM. TekmanWai Cheng (Mike) ThangAnil S. ThankiM. UhlMarius van den BeekDeepti VarshneyJennifer VessioP. VidemG. von KusterG. R. WatsonNatalie A. Whitaker-AllenUwe WinterM. WolstencroftF. ZambelliP. ZierepRand Zoabi
Nucleic Acids Research Published 2024/05/20

Summary:

Code development continues in line with the Galaxy Project roadmap, with improvements to job scheduling and the user interface, and general purpose graphical processing units (GPGPU) access for cutting-edge methods, and licensed tool support.

TÜLU 3: Pushing Frontiers in Open Language Model Post-Training
Nathan Lambert;Jacob Daniel MorrisonValentina PyatkinShengyi HuangHamish IvisonFaeze BrahmanLester James Validad MirandaAlisa LiuNouha DziriXinxi LyuYuling GuSaumya MalikVictoria GrafJena D. HwangJiangjiang YangRonan Le BrasOyvind TafjordChristopher WilhelmLuca SoldainiNoah A. SmithYizhong WangPradeep DasigiHanna Hajishirzi
ArXiv Published 2024/11/22

Summary:

This work introduces Tulu 3, a family of fully-open state-of-the-art post-trained models, alongside its data, code, and training recipes, serving as a comprehensive guide for modern post-training techniques.

Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
Amey Agrawal;Nitin KediaA. PanwarJayashree MohanNipun KwatraBhargav S. GulavaniAlexey TumanovR. Ramjee
Published 2024/03/04

Summary:

Sarathi-Serve introduces chunked-prefills which splits a prefill request into near equal sized chunks and creates stall-free schedules that adds new requests in a batch without pausing ongoing decodes, and uniform batches in Sarathi-Serve ameliorate the imbalance between iterations resulting in minimal pipeline bubbles.

InterPro: the protein sequence classification resource in 2025
Matthias Blum;Antonina AndreevaL. FlorentinoS. ChuguranskyTiago GregoEmma E. M. HobbsBeatriz Lázaro PintoAilsa K. OrrT. Paysan-LafosseIrina PonamarevaGustavo A. SalazarNicola BordinP. BorkA. BridgeLucy J ColwellJ. GoughD. HaftIvica LetunicFelipe Llinares-LópezAron Marchler-BauerLaetitia Meng-PapaxanthosHuai-Yu MiD. NataleC. OrengoA. P. PanduranganD. PiovesanC. RivoireC. SigristN. ThankiF. Thibaud-NissenP. D. ThomasSilvio C. E. TosattoCathy H. WuA. Bateman
Nucleic Acids Research Published 2024/11/20

Summary:

The status of InterPro is reported on, detailing new developments in the database, associated web interface and software, including the increased integration of structures predicted by AlphaFold and the enhanced description of protein families using artificial intelligence.

CoverM: read alignment statistics for metagenomics
Samuel T. N. Aroney;R. NewellJ. NissenA. P. CamargoGene W. TysonB. Woodcroft
Bioinformatics Published 2025/01/20

Summary:

A unified software package CoverM is presented, which calculates several coverage statistics for contigs and genomes in an ergonomic and flexible manner and avoids unnecessary I/O overhead by calculating coverage statistics from streamed read alignment results.

Genie: Generative Interactive Environments
Jake Bruce;Michael DennisAshley EdwardsJack Parker-HolderYuge ShiEdward HughesM. LaiA. MavalankarRichie SteigerwaldChris AppsY. AytarSarah BechtleFeryal M. P. BehbahaniStephanie ChanN. HeessLucy GonzalezSimon OsinderoSherjil OzairScott E. ReedJingwei ZhangKonrad ZolnaJeff CluneN. de FreitasSatinder SinghTim Rocktäschel
ArXiv Published 2024/02/23

Summary:

Genie is introduced, the first generative interactive environment trained in an unsupervised manner from unlabelled Internet videos, which enables users to act in the generated environments on a frame-by-frame basis despite training without any ground-truth action labels or other domain-specific requirements typically found in the world model literature.

OLMo: Accelerating the Science of Language Models
Dirk Groeneveld;Iz BeltagyPete WalshAkshita BhagiaRodney KinneyOyvind TafjordA. JhaHamish IvisonIan MagnussonYizhong WangShane AroraDavid AtkinsonRussell AuthurKhyathi Raghavi ChanduArman CohanJennifer DumasYanai ElazarYuling GuJack HesselTushar KhotWilliam MerrillJacob Daniel MorrisonNiklas MuennighoffAakanksha NaikCrystal NamMatthew E. PetersValentina PyatkinAbhilasha RavichanderDustin SchwenkSaurabh ShahW. SmithEmma StrubellNishant SubramaniMitchell WortsmanPradeep DasigiNathan LambertKyle RichardsonLuke S. ZettlemoyerJesse DodgeKyle LoLuca SoldainiNoah A. SmithHanna Hajishirzi
ArXiv Published 2024/02/01

Summary:

OLMo is built, a competitive, truly Open Language Model, to enable the scientific study of language models and it is hoped this release will empower the open research community and inspire a new wave of innovation.

StarCoder 2 and The Stack v2: The Next Generation
Anton Lozhkov;Raymond LiLoubna Ben AllalFederico CassanoJ. Lamy-PoirierNouamane TaziAo TangDmytro PykhtarJiawei LiuYuxiang WeiTianyang LiuMax TianDenis KocetkovArthur ZuckerYounes BelkadaZi-Jian WangQian LiuDmitry AbulkhanovIndraneil PaulZhuang LiWen-Ding LiMegan L. RisdalJia LiJian ZhuTerry Yue ZhuoEvgenii ZheltonozhskiiNii Osae Osae DadeW. YuLucas KraussNaman JainYixuan SuXuanli HeManan DeyE. AbatiYekun ChaiNiklas MuennighoffXiangru TangMuhtasham OblokulovChristopher AkikiMarc MaroneChenghao MouMayank MishraA. GuBinyuan HuiTri DaoA. ZebazeOlivier DehaeneN. PatryCan-Wen XuJulian J. McAuleyHan HuTorsten ScholakSébastien PaquetJennifer RobinsonC. AndersonNicolas ChapadosM. PatwaryNima TajbakhshYacine JerniteCarlos Muñoz FerrandisLingming ZhangSean HughesThomas WolfArjun GuhaLeandro von WerraHarm de Vries
ArXiv Published 2024/02/29

Summary:

The BigCode project, an open-scientific collaboration focused on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder2, a large model that significantly outperforms other models of comparable size and makes the model weights available under an OpenRAIL license.

PaliGemma: A versatile 3B VLM for transfer
L. Beyer;A. SteinerAndré Susano PintoAlexander KolesnikovXiao WangDaniel M. SalzMaxim NeumannIbrahim M. AlabdulmohsinMichael TschannenEmanuele BugliarelloThomas UnterthinerDaniel KeysersSkanda KoppulaFangyu LiuAdam GrycnerA. GritsenkoN. HoulsbyManoj KumarKeran RongJulian Martin EisenschlosRishabh KabraMatthias BauerMatko BosnjakXi ChenM. MindererP. VoigtlaenderIoana BicaIvana BalazevicJ. PuigcerverPinelopi PapalampidiO. HénaffXi XiongRadu SoricutJeremiah HarmsenXiao-Qi Zhai
ArXiv Published 2024/07/10

Summary:

PaliGemma is an open Vision-Language Model that is based on the SigLIP-So400m vision encoder and the Gemma-2B language model that achieves strong performance on a wide variety of open-world tasks.

DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
Zhi-Yu Wu;Xiao-Kang ChenZi-Zheng PanXing-Chao LiuWen LiuDa-Mai DaiHua-Zuo GaoYi-Yang MaChengyue WuBing-Li WangZhen-Da XieYu WuKai HuJiawei WangYao-Feng SunYukun LiY. PiaoKang GuanA. LiuXin XieYu-Mei YouKaihong DongXing-Kai YuHao-Wei ZhangLiang ZhaoYi-Song WangC. Ruan
ArXiv Published 2024/12/13
A foundation model for clinical-grade computational pathology and rare cancers detection
E. Vorontsov;A. BozkurtAdam CassonGeorge ShaikovskiMichał ZelechowskiKristen A. SeversonEric ZimmermannJ. HallNeil A. TenenholtzNicolò FusiEllen YangPhilippe MathieuA. van EckDonghun LeeJulian ViretEric RobertYi-Kan WangJ. KunzMatthew C H LeeJan H BernhardR. GodrichGerard OakleyEwan MillarMatthew G HannaHannah Y WenJuan A RetameroWilliam A. MoyeRazik YousfiC. KananD.S. KlimstraB. RothrockSiqi LiuThomas J Fuchs
Nature Medicine Published 2024/07/22

Summary:

Virchow is presented, the largest foundation model for computational pathology to date, and it is demonstrated that a large foundation model enables pan-cancer detection, achieving 0.95 specimen-level area under the receiver operating characteristic curve across nine common and seven rare cancers.

Who owns this site?

Article Galaxy Pages is a free service from Research Solutions, a company that offers access to content in collaboration with publishing partners, online repositories and discovery services.